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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



In re Application 

Inventor: Lester D. Nelson 

Appl. No.: 09/658,243 

Confirm. No.: Unknown 

Filed: September 8, 2000 

Title: A PERSONAL COMPUTER AND SCANNER 
FOR GENERATING CONVERSATION 
UTTERANCES TO A REMOTE LISTENER IN 
RESPONSE TO A QUIET SELECTION 



PATENT APPLICATION %. 



Art Unit: 
Examiner: 



2682 

Unassigned 



Customer No. 23910 



% 



x 



CERTIFICATE 

I hereby certify thatims correspondent 
postage as first class mail ir^a^mvelope addressed 
August 28, 200 



Larry T. Harris, Reg. No. 44,745 
Signature Date: August 28, 200 1 




AILING UNDER 37 CF.R. §1.8 

(being deposited in the United States Postal Service with sufficient 
missioner for Patents, Art Unit 2682, Washington, DC 20231, on 



_( Attorney Signature) 



TRANSMITTAL LETTER 



Commissioner for Patents 
Art Unit 2682 
Washington, DC 20231 

Sir: 



RECEIVED 

SEP 0 4 2001 
Technology Center 21 00 



Transmitted with this communication in connection with the above-identified application is an 
Information Disclosure Statement pursuant to 37 CF.R. § 1 . 56. No fee is required with this communication. 

The Commissioner is hereby authorized to charge underpayment of any fees associated with 
this communication or credit any overpayment to Deposit Account No. 06- 1 325. A duplicate 
copy of this authorization is enclosed. 



Date: 



Respectfully submitted, 



By; 




Larry T. Harri, 
Reg. No. 44 




FLIESLER DUBB MEYER & LOVEJOY LLP 
Four Embarcadero Center, Fourth Floor 
San Francisco, California 94 1 1 1 -4 1 56 
Telephone: (415) 362-3800 
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Inventor: Lester D. Nelson 
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Confirm. No.: Unknown 

Filed: September 8, 2000 

Title: A PERSONAL COMPUTER AND SCANNER 
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PATENT APPLICATION 



Art Unit: 
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Customer No. 23910 
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Technology Center2100 



CERTIFICATE OF MAILING UNDER 37 C.F.R. §1.8 

I hereby certify that truycorrespondence is being deposited in the United States Postal Service 
with sufficient postage as firsMlass mail in an envelope addressed to Commissioner for Patents, 
Art Unit 2682<^ashington, DO20231, on August 28. 2001 . 




rT. Harris, Reg. No7M,745 
Signature Date: August/8, 2001 




_( Attorney Signature) 



INFORMATION DISCLOSURE STATEMENT UNDER 37 C.F.R. §1.56 

Commissioner for Patents 
Art Unit 2682 
Washington, DC 20231 

Sir: 

It is requested that the information identified in this statement be considered by the Examiner and 
made of record in the above-identified application. This statement is not intended to represent that a search 
has been made or that the information cited in the statement is, or is considered to be, material to patentability 
as defined in 37 C.F.R. § 1.56. If this is a continuation, divisional or continuation-in-part application, it is 
understood that the Examiner will consider all information which was considered by the Office in a parent 
application. MPEP §609. Such information therefore is not listed herein unless it is desired that the information 
be printed on a patent issuing from the subject application. 



Enclosed with this statement are the following: 

/ Form PTO-1449. The Examiner is requested to initial the form and return it to the undersigned in 
accordance with M.P.E.P. §609. 

/ A copy of each cited document as required by 37 C.F.R. §1.98. Copies are not submitted of 
documents previously submitted by the applicant in a parent application from which benefit under 3 5 
U.S.C. § 1 20 is claimed, 37 C.F.R. § 1 .98(d)(1), with an information disclosure statement submitted 
in the parent application which complies with the Sept. 8, 2000 or subsequent revision of 37 C.F.R. 
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§ 1 .98(a-c). If any of the cited/submitted documents is in a foreign language, a concise explanation 
of relevance is provided pursuant to 37 C.F.R. § 1 .98(a)(3)(i). For foreign language documents cited 
in a search report by a foreign patent office, the requirement for a concise explanation of relevance 
is satisfied by the submission herewith of an English language version of the search report. MPEP 
§609 A(3) . If a written English-language translation of a non-English language document, or portion 
thereof, is within the possession, custody or control of, or is readily available to any individual 
designated in § 1.56(c), a copy of the translation accompanies this statement, 37 C.F.R. 
§1.98(a)(3)(ii), and satisfies the requirement for a concise explanation of relevance, MPEP 
§609A(3). 

This statement should be considered because: 

/ 37 C.F.R. §1.97(b). This statement qualifies under 37 C.F.R. §1.97, subsection (b) 
because: 

( 1 ) It is being filed within three months of the filing date of an application other than a 
continued prosecution application under § 1.53(d); 

-- OR » 

(2) It is being filed within 3 months of entry of a national stage; 

« OR 

(3) It is being filed before the mailing date of the first Office Action on the merits, 

- OR - 

(4) It is being filed before the mailing date of the first Office Action after the filing of 
a Request for Continued Examination under 37 C.F.R. §1.1 14. 

/ Fee Authorization. The Commissioner is hereby authorized to charge underpayment of any 
additional fees or credit any overpayment associated with this communication to Deposit Account 
No. 06-1325. A duplicate copy of this authorization is enclosed. 



Respectfully submitted, 



Date: 




FLIESLER DUBB MEYER & LOVEJOY LLP 
Four Embarcadero Center, Fourth Floor 
San Francisco, California 94 1 1 1 -4 1 56 
Telephone: (415) 362-3800 
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Form PTO-1449 

(Substitute) 



U.S. DEPARTMENT OF COMMERCE 
PATENT AND TRADEMARK OFFICE 



INFORMATION DISCLOS 
BY APP. 

(Use several 



^STATEMENT 



if necessa 



Attorney Docket Number 
FXPL-01025US0 



Serial/Patent Numbei 

09/658,243 



PHceivBd 



Applicant/Patent Owner: Lester D. Nelson 



Filing/Issue Date: 

September 8, 2000 



Group Art Unit! 2682 



Iecnnoiogyuent6r2100 



3 0 2001 



U.S. PATENTS 



Examiner 
Initial 




Patent Nt®fe«ihj« 


i@&'^ssue Date 


First Named Inventor 


Class 


Subclass 


Filing Date 




1. 


4,241,521 


12/30/1980 


Dufresne 


434 


112 


09/13/1976 




2. 


4,515,995 


5/7/1985 


Bolick, Jr. et al. 


179 


6.13 


080/3/1981 




3. 


4,517,410 


5/14/1985 


Williams et al. 


179 


6.04 


04/02/1982 




4. 


4,591,664 


5/27/1986 


Freeman 


179 


6.06 


11/23/1982 




5. 


4,661,916 


4/28/1987 


Baker et al. 


364 


513.5 


12/27/1985 




6. 


4,663,777 


5/5/1987 


Szeto 


379 


88 


12/17/1984 




7. 


4,715,060 


12/22/1987 


Lipscher et al. 


379 


70 


07/15/1985 




8. 


4,985,913 


1/15/1991 


Shalom et al. 


379 


76 


08/29/1989 




9. 


5,029,214 


7/2/1991 


Hollander 


381 


51 


08/11/1986 




10. 


5,210,689 


5/11/1993 


Baker et al. 


364 


419 


12/28/1990 




11. 


5,259,024 


11/2/1993 


Morley, Jr. et al. 


379 


88 


04/24/1992 




12. 


5,297,041 


3/22/1994 


Kushler et al. 


364 


419.15 


03/16/1992 




13. 


5,668,868 


9/16/1997 


Norden strom 


379 


447 


04/08/1996 




14. 


5,790,957 


8/4/1998 


Heidari 


455 


553 


09/12/1995 




15. 


5,822,403 


10/13/1998 


Rowan 


379 


68 


08/21/1996 




16. 


5,920,303 


7/6/1999 


Baker et al. 


345 


133 


12/15/1997 




17. 


5,991,374 


11/23/1999 


Hazen field 


379 


101.01 


08/08/1996 



PENDING U.S. PATENT APPLICATIONS 



Examiner 
Initial 



Application Number 



Filing Date 



First Named Inventor 



Petition to 
Expunge? 



Yes 



No 



18. 



09/657,370 



9/8/2000 



Nelson 



19. 



09/658,673 



9/8/2000 



Nelson 



X 



20. 



09/658,612 



9/8/2000 



Nelson 



21. 



09/658,245 



9/8/2000 



Nelson 



X 
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\ £/ FOREIGN PATENT DOCUMENTS 


Examiner 
Initial 




Document Number 


Publication 
Date 


Country 


Class 


Subclass 


Tra 
lat 
Yes 


ins- 
ion 
No 




















OTHER DOCUMENTS (Include author (if any), title, publisher and place of publication, date and pertinent pages) 




22. 


"Automated Braille Display," Appalachian State University. http://wwwl .aapstate.edu/dept/phvsics/weather/ 
braille display.html and "JPEG Image," http:/wwwl. appstate.edu/dept/physics/weather/proto5.jpg. 




23. 


"ATI Announces New Software Solution for Professionals -- EvaluWare™," Assistive Technology, Inc., July 30, 
1999, http://www.assistivetech.com/p-multivoice.htm 




24. 


Brodv. M.. Cell Phones: Clever Communications But Etiauette Disconnect http://www.mi crosoft.com/BIZ/ 
features/advice/brody/archive/cellphones.asp 




25. 


Jacobson, D., "Release of TalkToMe! VI. 0," macinsearch.com, March 3, 1999, http://www.machinsearch.com/ 
news/1 9990309/news 1 9990309.2 1 650.5.shtml 




26. 


Marti, S. and Schmandt, C, "Active Messenger: filtering and delivery in a heterogeneous network," draft submited to 
Ubicomp 200 J, http://www.media.mit.edu/~stefanm/thesis/ActiveMessenger_conf_2001_04_20_ draft.pdf 




97 


wny ivimspeaKyy, rrcniKc ivumicn v^oirrpdnY, niip.// www.prenixoiTi.com/spcccn/ spec 




28. 


Nelson, D., "Time Marches on - iust listen to it!," April 2, 1999, http://www.modbee.com/metro/storv/ 
0%2C1 1 13%2C73735%2C00.html 




zy. 


"What is Portico?" http://wwwxonectus.com/portico/portico.asp 




30. 


"The Teleface Project," The Royal Institute of Technology, http://www.speech.kth.se/teleface/ 




31. 


Phone-Fun Special Effects Machine. Shop Vovaeer.com, Cataloe number #TE2200, www.shopvovager.com 




32. 


"TTS: Synthesis of audible speech from text," AT&T Labs - Research. 2000, http://www.research.att.com/ 
projects, tts 




33. 


Babel Technologies, http://www.babeltech.com/ 




34. 


"Welcome to Our Multilingual Text-to-Speech Systems," Lucent Technologies, Bell Labs Innovations, 
http://www.bell-labs.com/proiect/tts 




35. 


"Tru Voice from Centigram," http://svr-www.eng.ca.ac.uk/comp.speech/Section5/Svnth/rruvoice.hrinl 




36. 


"DIXI+ A Portuguese Text-to-Speech Synthesizer For Alternative and Augmentative Communication," Instituto 
de Engenharia de Sistemas e Computadores and Centro de Unguis tica da Universidade de Lisboa, 1999-2001 , 
http://www.speech.inesc.pt/-lco/dixiplus/abstract.html 




37. 


"Elan Text to Speech," Elan Informatiaue, http://www.elantts.corn/speech/shared/ess2txt.htm 




38. 


"The Festival Speech Svnthesis Svstem." The Universitv of Edinburgh, http://www.cstr.ed.ac.uk/proiects/ 
festival/ 




39. 


"The Epos Speech Svnthesis Svstem," http://epos.ure.cas.cz 




40. 


"iSPEAK: Let your text be heard," Fonix Corporation, September 2000, http://www.fonix.com/products/ ispeak. html 
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41. 


"Speech Technoloev Group: Text-to-Speech Demo for SpanishfconcatenativeV GTH. http://www-eth.die.upm. 
es/research/svnthesis/svn th-form-concat.html 




42. 


"German Festival/VMS Phonetik, Institute of Natural Language Processing, University of Stuttgart, Germany, 
http://www.ims.uni-stutteart.de/phonetik/svnthesis 






"Hadifix," Institute of Communications Research and Phonetics, University of Bonn, Germany, 
http://www.ikD.uni-bonn.de/~trjo/Hadifix.en.html 




44. 


"IBM Voice Systems," http://www-4.ibm.com/software/speech 




45. 


"Speech Technoloev," Microsoft Research, http://research.microsoft.com/sre/ 




46. 


"FLUET," NTT Communication Science Laboratories, http://www.kecd.ntt.co.ip/research/index.html 




47. 


OGI-Festival, http://cslu.cse.oei.edu/tts/main.html 




48. 


Fister, Beat, "The SVOX Text-to-Speech System," Computer Engineering and Networks Laboratory, Swiss 
Federal Institute of Technology* Zurich, September 1995, http://www.tik.ee.ethz.ch/-sor/SPGinfo/nodel 1 .html, 
Pfi95, 4 pages. 




49. 


"Magic Voice," Samsune AIT HCI Lab., http://hci.sait.samsune.co.kr.mvoice 




50. 


"About Say..." http://wwwtios.cs.utwente.nl.sav/about sav.htmt 




51. 


"Speechsynthesis: the Multilingual Text-to-Speech System from Gerhard-Mercator-University Duisburg," 
http://sun5.fb9-ti.uni-duisbure.de/demos/speech.html 




52. 


Cohen, P.R., "The Role of Natural Language in a Multimodal Interface," Proceedings of the First Annual ACM 
Symposium on User Interface Software and Technology, 1992, pp. 143-149. 




53. 


Thorisson, K.R., "Gandalf: An Embodied Humanoid Capable of Real-time Multimodal Dialogue with People," 
j i uirCtzuirigd uj trie nrai initzrnuiiuriui i^unjtzrfznce on /wiionomous /igenib, iyy /, pp. jjO-jj / . 




54. 


Greenberg, S., "Teaching Human Computer Interaction to Programmers," Volume 3, Number 4, ACM 

Ifiipmrfinnv Tnlv- A 11 cruet lQQf\ A(~*\A Pr^cc r\r\ fi*DJl{\ 
i flier uitiitJfio , J uijf-/AujjUoi i77Uj /vv^ivi riCoj. KK* 




55. 


Baker, B. (1982, September). "Minspeak: A Semantic Compaction System that Makes Self-Expression Easier for 

frHTnYiiinirarivplv DicnVil^H TnHiviHiifilc " 7 r*n 1 S6_ / 7fl9 i Cpp R*»mat*Lrc\ 




56. 


Baker, B. (1986). "Using Images to Generate Speech," Byte, 1 1, pp. 160-168. (See Remarks) 




57. 


Bruno, J. (1989). "Customizing a Minspeak system for a Preliterate Child: A Case Example," Augmentative and 
Alternative Communication, 5, pp. 89-100. (See Remarks) 




58. 


Deegan, S. (1993, June). "Minspeak: A Powerful Encoding Technique," Communicating Together, 1 1(2) pp. 22-23. 
(See Remarks) 


Examiner 


Date Considered 


♦EXAMINER: Initial if citation considered, whether or not citation is in conformance with MPEP 609. Draw line through citation if 
not in conformance and not considered. Include copy of this form with next communication to applicant. 


* 1 = Copy not submitted because it was submitted in prior application SN / , filed , 20 , relied on under 35 USC 
§120. 

*2 = Copy not submitted because it was submitted in prior application SN / , filed , 20 . relied on under 35 USC 
§120. 
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The followingRemarks are supplied as part of or in supplement to this Information Disclosure 



55. A complete copy of this publication has been ordered and will be forwarded to the PTO upon 
receipt by Fliesler Dubb Meyer & Lovejoy. 

56. A complete copy of this publication has been ordered and will be forwarded to the PTO upon 
receipt by Fliesler Dubb Meyer & Lovejoy. 

57. A complete copy of this publication has been ordered and will be forwarded to the PTO upon 
receipt by Fliesler Dubb Meyer & Lovejoy. 

58. A complete copy of this publication has been ordered and will be forwarded to the PTO upon 
receipt by Fliesler Dubb Meyer & Lovejoy. 



Statement. 
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sep o 4 zom 

Technology Center 21 oo 
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